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1. INTRODUCTION 


Decision Making is the scientific study of the processes involved 
in the rational selection of a best alternative from among a group 
of available alternatives. Decision Making comes in two forms. 
"Descriptive" decision making attempts to characterize how a 

single individual or a group of individuals actually make decisions; 
"prescriptive" decision making attempts to formulate guidelines 

for how individuals should make decisions. In the more general 
sense, decision making is problem solving and, thus, touches 

many related scientific fields: Mathematics, Computer Science, 
Psychology, Operations Research, etc. This report outlines decision 
making and its relation to other scientific areas of study: 


. Decision Theory 

. Mathematics 

Decision Models 

. Artificial Intelligence > 
Psychology 


HN OF FP W PP ~~ 


. Operations Research 


Section 3 presents a collection of definitions of all of the terms 
found in the outline with a list of references found in Section 4. 
The Appendix lists frequently used abbreviations of companies and 
institutions. | | 
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1.1 Utility Theory 
1.1.1 Axioms — 
1.1.2 Subjective Utility 
1.1.3 Indifference Curves 
1.1.4 Multi-Attribute Utility 
1.2 Decision Trees 
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.2.1 Optimal Paths 
-2.2 Sensitivity Analysis 


Matrices 


.3.1 Maxi-min Strategy 
.3.2 Maxi-max Strategy 
.3.3 Hurwicz Strategy 
.3.4 Savage Regret Strategy 
.3.5 Expected Value Strategy 


1.4 Value of Information 


1.5 Statistical Decision Theory 
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Hypothesis Testing 

Levels of Significance 

Type I and Type II Errors 
Statistical Decision Rules 
Statistical Inference 

Expected Opportunity Loss 
Economics of Sampling | 
Revision of Prior Probabilities 


1.6 Group Decision Making 
1.6.1 Group Utility 
1.6.2 Pareto Optimality © 
1.6.3 Conflict Resolution 
1.7 Risk Analysis 
1.7.1 Alpha Beta Risk 
1.7.2 Risk Sharing 


2. Mathematics 


2.1 Probability Theory 
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2.2 Statistics 
2.2.1 Statistical Measurement 


2.2.2 Normal 
2.2.3 Sampling 


Probability Measurement 


Conjunctive Events 
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Frequency Analysis 
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Probability 


Joint Probability 
Conditional Probability 


Event Dependence 
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.11 Binomial Distribution 
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.| Mean 

.2 Median 

.3 Mode 

-4 Average Deviation 
.5 Variance _ 
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Distribution | 


2.2.4 Regression Analysis 


2.3 Game Theory 


2.3.1 Mini-Max Strategy 


2.3.2 Gambling 


2.4 Information Theory 


3. Decision Models 

3.1 Knowledge Elicitation 
3.1.1 Decision Tree Program 
3.1.2 TREE 
3.1.3 GODDESS 

3.2 Adaptive Decision Aiding 
3.2.1 ADDAM 
Ss2e2 ACTS 

3.3 Utility Models 
3.3.1 MAUM 
3.3.2 EVAL 

3.4 Probability Models 
3.4.1 PIP 
3.4.2 Lotteries 

3.5 Planning Models 
3.5.1 GAKU 
3.5.2 Group Decision Aid 


4. Artificial Intelligence 
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Base Systems 

MYCIN 
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HEARSAY 
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DENDRAL 

INTERNIST 

Problem Solving System 
RITA 


4.2 Heuristic Search 


4.2.1 Resource Allocation Search 
4.2.2 Mini-Max Search 
4.2.3 Alpha Beta Pruning 
4.3 Knowledge Representation 
4.3.1 Semantic Nets 
4.3.2 Frames 
4.3.3 Production Rules 
4.4 Machine Learning 


5. Psychology 
5.1 Subjective Judgment 
| 5.1.1 Subjective Utility 

5.1.2 Subjective Probability 
5.1.3 Probability Calibration 

5.2 Cognitive Psychology . 
5.2.1 Perception 
5.2.2 Learning 
5.2.3 Memory 

5.3 Decision Training 

5.4 Bargaining 


6. Operations Research 
6.1 Pattern Recognition 

6.1.1 Linear Classifiers 
6.1.2 Non-Deterministic Classifiers 
6.1.3 Feature Extraction | 
6.1.4 Error Estimation 
6.1.5 Clustering 

Linear Programming 

Monte Carlo Simulation 

Systems Analysis 

Management 

PERT Charts 

Queueing Theory 
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DOW DD DD DD AO 
mo ON DD oO HP W PO 


Scheduling 


3. DEFINITIONS 


ACTS - The Adaptive Computerized Training System (ACTS) was developed at. 
Perceptronics, Inc. in 19/76. It uses the technique of adaptive decision 
aiding to train students in electronic circuit analysis. The system can 
build an internal model of the trainee's decision strategy while debugging 
an electronic circuit fault. This model, when compared with an expert model . 
already stored in the machine, directs the area of required training. 
(17,35,36,62) 


Adaptive Decision Aiding - Adaptive Decision Aiding is a decision support 
technique based on pattern recognition. A computer decision model monitors 
(in real time) the decision alternatives chosen by a human operating an 
interactive computer system. The pattern recognition component builds an 
‘internal model of the operator's decision Strategy and then uses it to 

aid the human in his task through feedback on a display terminal. 
(5,17,35,36,37,62,65,100) 


ADDAM - The Adaptive Dynamic Decision Aiding Model (ADDAM) was developed at 
Perceptronics, Inc. in 1975. It uses the adaptive decision aiding technique 
to aid the Tactical Coordination Officer aboard the P3-C anti-submarine 
warfare aircraft for the Navy. 

(35,36,62) | 


Alpha Beta Pruning - The number of possible combinations that must be 
explored when using mini-max heuristic search can be greatly reduced by 
employing the technique of alpha-beta pruning. The method ignores certain 
strategies which would produce an inferior action when compared to those 
that have already been found. It permits a tree to be searched approximately 
twice as deep in the same amount of time. 

(9,28,65,80,115) 


Alpha Beta Risk - Alpha risk is the maximum probability of encountering 
a Type I error; beta risk is the maximum probability of a Type II error. 
(7,23,53,89) 


Artificial Intelligence - Artificial intelligence is the branch of Computer 
Science that deals with the machine simulation of human mental and cognitive 
processes, behavior, and problem solving activities. 
(2,9,18,27,28,50,59,71,75,80,81,91 , 96,115) 


Average Deviation - A statistical measure, the average deviation is an 
indication of the uniformity or dispersion within a set of numbers. 


Z| X-X| 
n 


where n is the number of numbers in the set and X is the mean (average). 
This measure computes the average distance of each number X from the 
average of the entire set. | | | 

(42,53,101) 

Axioms - The axioms of Utility were formulated by R.D. Luce and H. Raiffa 
in 1967. The axioms specify rational decision making behavior with respect 
to the selection of a best decision alternative given a series of preference 
choices. | | 
(23) 


Bargaining - The area of bargaining includes methodologies and techniques 
toaid the mutually agreeable division of limited resources among a group 
of individuals such that personal utility is maximized. 

(89) 
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Bayes' Rule - Bayes' Rule makes it possible to determine a conditional 
probability when given the complementary (reverse) conditional probability 
and the relevant marginal probabilities. 


~—-P(E|X)P(X) 
PS 
z P(E|X, )P(X,) 


where E is an event and X is one of a set of mutually exclusive events Xs. 
(23,26,29,45,53,87,89,114) 


Binomial Distribution - The general binomial distribution is a family of 
probability distributions describing the probabilities of the possible 
experimental outcomes for all possible combinations of the total number 

of experimental trials n and the probability of success on each trial p. 

If r is the number of successes in n trials, then: | 

(13,26,53) | | 

| a 

—— pl (1-p)"" 


P(r|n.p) r!i(n-r)! 


Clustering - Clustering is a technique in pattern recognition used to 
formulate major classes of objects when these classes are not known in 
advance. | | 
(5,37,41,79,115,116) 


Cognitive Psychology - Cognitive psychology is the psychology of human 
mental processes involving intelligent thought and its relation to 
learning, perception, and memory. 

(2,19,50,70,76,90,92 ) 


W 


fe 
Ne 
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Conditional Probability - The conditional probability is the probability 
that a sample from a large population has a specific characteristic given 
that it already possesses certain other pre-specified characteristics. 
(7,13,26,42,45,53,89,101) 

Conflict Resolution - Relating to decision making, conflict resolution is 
the attempt to arrive at an agreeable group estimate when individual 
members of the group differ widely in their personal estimates. Methods 
include averaging, majority voting, multi-attribute utility modeling, and 
one-man rules.. | 

(6,21,24,63) 


Conjunetive Events - A conjunctive event is a single probabilistic event 
which is composed of two or more related events all of which must occur 
before the major event can be said to occur. 

(7,26,53) | 


Decision Making - Decision Making is the scientific study of the processes 
involved in the rational selection of a best alternative from among a group 
of available alternatives. "Descriptive" decision making attempts to 
characterize how individuals actually make decisions; "prescriptive" 
decision making attempts to formulate guidelines for how individuals 
‘should make decisions. | 

(23,55,89) | 


Decision Models - A decision model is a structure or a procedure (usually 

a computer program), that has embedded within it, mathematical algorithms | 
for good decision making. The purpose of a decision model is to help a 
human decision maker structure and solve his problem by (1) decomposing it 
into manageable parts, (2) analyzing each part separately, and (3) deriving 
a decision conclusion by computational means. 
(1,3,5,29,36,40,58,62,63,64,71 ,86,88,97,100,104,117,122) © 
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Decision Theory - Decision Theory or Decision Analysis involves the 
construction of guidelines for advising individuals how to make 
rational decisions that will maximize their personal utility. 
Mathematical models and algorithms are used which deal with problem 
Structuring and alternative selection independently of domain 
application. 

(23 ,53,55,89,105,108,120) 


Decision Training - The ability to make good decisions is one that can 
be taught. A good decision maker chooses a best alternative according 
to pre-set criteria given the amount of available information and 
Should not be judged solely on the basis of successful outcomes. 
(97,98) 


Decision Trees - A decision tree is a picture of possible alternative 
courses of action interspersed with events that have an uncertain 
outcome. Each path in the tree corresponds to one possible state of 
affairs in the future. By assigning utilities and probabilities to 
various nodes and arcs in the tree, a best (optimal) path can be | 
determined which forms the basis for the decision choice. | 
(3,7,10,11,13,15,34,43,47,53,56,57,63,64,74,82,84,88,89,104,122) 


neighbors complain 


no neighbor problem 


kids don't like it 


get a cat 


kids like it 
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Decision Tree Program - The Decision Tree Program is a computerized 
elicitation model developed in 1976 at UCLA by A. Leal. It aids a 
decision maker in constructing a decision tree for any application 
area. The system uses sensitivity analysis to direct the tree 

growth and recommends a best alternative based on the optimal paths. 
(63,64) 


DENDRAL - DENDRAL is a knowledge-based system developed at Stanford 
University by E.A. Feigenbaum, B. Buchanan, and J. Lederberg for 

the purpose of expert consultation in the area of analysis of electron 
emission spectrograms for determining chemical structures. 


(6) 


Disjunctive Events - A disjunctive event is a single probabilistic 
event which is composed of two or more related events. The major 
event can be said to occur if any one of the related events occurs. 
For example, a tournament chess game can be won by (1) the opponent 
resigning, (2) the opponent's clock running out first, or (3) check- 
mating the opponent's King. 

(7,26,53) 


Economics of Sampling - Sampling economics attempts to place a 
monetary value on the information that may be gained by sampling. 


This includes the calculation of expected value of sample information, the © 


expected value of perfect information, the selection of an optimal 
sample size, and the calculation of the net- gain from sampling. 
(7,13,42,53,93) 
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Error Estimation - Pattern recognition Systems are not 100% correct 
in their classification of objects. Error estimation, as related 

to pattern classifiers, is a process of determining the probability 
of correct classification. 

(26,79,116) 


EUFID - The End-User Friendly Interface to Data Management Systems 
(EUFID) is a knowledge-based system developed at System Development 
Corp., Santa Monica, Ca. by J. Burger, I. Kameny, and A. Leal for 

the purpose of natural language interface to relational data management 
systems. 


(6) 


EVAL - A decision aiding model developed at DDI, EVAL incorporates 
decision payoff matrices with probability estimates for solving 
Single "one-shot" decision problems. | 
(10,11,12,29,57,83) 


Event Dependence - An event B is said to be "independent" of an 
event A if P(BJA)=P(B). That is, the probability of B given that A 
has occurred is the same as the probability of B alone. Event A has 
no effect on event B. | 
(7,26,53) 


Expectation - The expectation of a particular event X is the value 
(worth) of each possible outcome V(X, ) multiplied by the corresponding 
probability of occurrence P(X, ) and summed. 


E(X) = £ V(X,)P(X,) 
| 1 


where x. are the mutually exclusive outcomes of event X. 
(7,13,26,53) | 


Expected Opportunity Loss - Loss of expected opportunity is the cost 
of uncertainty when making a decision with less than perfect 
information. It can be determined by summing the losses for each 
expected event outcome multiplied by the corresponding probability 
of the events. | 

(7,13,53,89,101) 


Expected Value Strategy - The expected value Strategy is a decision 
rule for use with a decision payoff matrix that contains estimates 

of the probability of occurrence for each outcome (column). For 

each row (decision strategy), multiply each entry by the corresponding 
probability and sum. Then choose the strategy with the highest 
(expected) value . 

(55) 


Feature Extraction - The success of a pattern recognition system is 
dependent upon the quality of the features (attributes) of the objects 
that are to be classified. Feature extraction is the process of 
identifying the relevant attributes to be measured. No adequate 
procedure for automatic feature extraction has yet been derived. 
(41,62,79,115,116). | 


Frames - Frames are a method of representing knowledge in a knowledge- 
based system. A frame is a knowledge "chunk" that has a collection 

of definitional and procedural knowledge items about a particular 
object, action, or concept. It is characterized by the existence 

of "slots" (blanks) which can be filled in to describe any particular 
instance of the object, action, or concept. 


(6) 


16 


Frequency Analysis - Analysis of frequency involves the breakdown 
of a population into relevant subsets with measures describing the 
relative sizes of the subsets with respect to the entire population. 
Such analysis leads to the construction of a frequency table and 

the determination of marginal and conditional probabilities. 

For example, | | 


MALE FEMALE Totals 


Smokers 3 2 5 
Non-Smokers iZ 4 5 


Totals 4 6 10 


GAKU - The GAKU System (from a Japanese word for learning) is a 
computerized planning model developed at System Development Corp. 
in 1970 by A. Hormann and A. Leal. The planning model allows for. 
the statement of objectives abd decision actions with a capability 
for recursion to solve sub-problems. 
(50) | 


Gambling - To gamble is to engage in a game of chance in which the 
outcome determines a gain or loss of money. Gambling games provide | 

a simple environment for the study of human decision making. | 
(14,20,26,46,52,102,118,121) 

Game Theory - Game theory is the study of conflict between individuals 
and groups. Game theory assumes an active, aggressive opponent rather 
than a passive random world. 
(18,20,22,26,46,52,54,55,61,75,91,95,102,109,112,118,121) 
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GODDESS - The Goal-Directed Decision Structuring System (GODDESS) 

is currently under development at UCLA by J. Pearl, J. Saleh, and 

A. Leal and is a decision knowledge elicitation model that structures 
the decision problem starting from the goal and working backwards 

= through possible actions that could be taken to achieve the goal. 
_Action preconditions as well as side effects that could hinder 

goal fulfillment. are also taken into account. 

(83) 


Group Decision Aid - The Group Decision Aid was developed at Perceptronics 
Inc. in 1977 by A. Leal, S. Levin, and P.C. Gardiner and is based on 
a decision tree elicitation model for the Structuring of a decision 
problem by a small panel of experts working as a unified group. 

Conflict resolution is solved by using malti-attribute utility analysis. 
(63) 


Group Decision Making - Group decision making is the attempt, by a 
group of individuals working together, to combine their knowledge 
and expertise to solve a common decision problem. 
(24,47,51,63,89,103,107) | 


Group Utility - Group utility is a single measure of utility which 

is mathematically derived from the utilities of all members of a 
group.. Common measures are the arithmetic mean and the geometric mean. 
(51,63,89,103,107) 


HEARSAY - The HEARSAY system is a knowledge-based system developed 
at Carnegie Mellon University, Pittsburg, Pa. by D.R. Reddy for the 
purpose of speech understanding. 


(6) 
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Heuristic Search - Heuristic search is a technique from the field 

of Artificial Intelligence which explores possible future outcomes 
given the current state of affairs and actions which can be taken. 
All possible future situations are simulated and evaluated and a best 
current action is chosen based on its likelihood of producing a 
desirable outcome. 

(8,9,18,28,65,71,75,80,81,91,115) 


Hurwicz Strategy - The Hurwicz strategy is a decision rule for use 
with a decision payoff matrix. Take each decision strategy (row) 
and compute a weighted average of the best value b and the worst 
value w using weight «. | 
A. = «b + (l-«)w 


Select the strategy with the highest average A.. 
(55) 


Hypothesis Testing - A "hypothesis" in statistics is any unambiguous 
statement concerning a characteristic of a large population of items. 
"Hypothesis testing" is a procedure of classical statistical inference 
which incorporates sampling in a decision process to (1) accept the 
hypothesis, (2) reject the hypothesis, or (3) postpose the decision until. 
more information can be collected. | 
(7,13,42,53) 


Indifference Curves - Indifference curves are a sets of curves describing — 
a person's preferences over a wide range of alternatives. All points 
on a single curve depict different selection situations in which the 
person is indifferent as to choice. 

(55,89) | 


Information Theory - Information theory was developed in 1948 by 
C.E. Shannon and describes the concepts dealing with the production 
and transmission of data along a number of discrete channels. The 
theory encompasses channel capacity, entropy, coding theorems, and 
error-correcting codes. 

(25,110) 


INTERNIST - INTERNIST is a knowledge-based system developed at the 
University of Pittsburg by H. Pople and J. Myers for the purpose of 
medical diagnosis for internal medicine using abduction. 


(6) 


Joint Probability - The probability that a sampled item from a 
population has multiple characteristics from a frequency table 
is a joint probability. The probability of each characteristic 
separately is taken from the marginal probabilities. 

(7,26,53) 


Knowledge Base Systems - A knowledge base is a computed-based system 
‘in which knowledge (data and procedures) is stored and collected in 
one or more "compartments" (called knowledge sources) in order to 
facilitate problem solving and reasoning in a single, well-defined 
problem domain. Unlike generalized problem-solving systems, knowledge- 
based systems must accumulate large amounts of knowledge in specific 
domains and rely on domain-specific problem-solving techniques that 
can be developed to a high level of expertise. 

(6,27,71,76,80,106) | 
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Knowledge Elicitation - A knowledge elicitation decision model depends 
on problem-specific input from the decision maker. This knowledge, 
combined with the capability to structure decision problems, allows 

the model to aid the decision maker in a wide range of application 
areas. Such models behave like decision analysts who are familiar 

with decision making techniques but require detailed problem information 
to solve specific decision tasks. _ 
(3,10,12;,21,23,29,31,50,57,63,64,87,88,89,99,122) 


Knowledge Representation - Knowledge representation schemes allow 
human knowledge to be input to a computer system and used to solve « 
problems. The selected scheme is based on the type and amount of 
knowledge to be stored. Typical schemes are numerical data arrays, 
text data banks, logical deduction networks, concept graphs, semantic 
graphs, hierarchical structures, meta-data systems, etc. 
(2,4,6,15,34,59,60,80, 96, ) 


Learning - A branch of Cognitive Psychology, learning theory attempts 
to model the intelligent human capacity for creating generalizations, 
| relations, and inference based on a few observed objects and events. 
(2,50,61,70,73,90, ) | 


Levels of Significance - Part of hypothesis testing in statistics, a 
level of significance is a probability level at which the hypothesis 
will be tested. It is the point at which the sample results will be 
considered inconsistent with the hypothesis and is identified in 
advance of obtaining the sample. | | 
(7,13,53)) | 
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Linear Classifiers - A linear classifier is a pattern recognition 
model that uses a linear function as a discriminant for the 
categorization of objects. As such, a linear classifier does not 
perform well if the objects cannot be separated by straight 
~hyper-planes. 

_ (5,35,36,37,115,116) 


Linear Programming - Linear programming is a computational technique 
that attempts to maximize a series of linear functions given a set 
of linear constraints on the inputs. 

(7,13,22,95,109,118) 


Lotteries - A lottery is a device used to determine a person's. 
subjective utility about different choices. The lottery is usually 
depicted in the form of a random spinner with known outcomes and 
probabilities. For example, which would you rather have: (1) $10 for 
certain or (2) a chance to play this lottery? 


No money 


— $20 


Machine Learning - Machine learning is a term applied to a computer. 
software system that is able to be modified as a result of its use. 
Modification can come from a number of different sources including the 
program itself. Typical sources of modification are: a programmer 
changing the internal code, a user inputting new parameters, a program 
that adjusts its own internal parameters by experience, a system that 
re-writes its own programs, a system that. organizes itself. 
(5,17,28,35,36,37,41,50,61 ,62,65,79,80,91 100,115,116) 
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Management - The process of management concerns the allocation of 

an organization's inputs (human and economic resources) by planning, 
organizing, directing, and controlling for the purpose of producing 
outputs (goods and services) desired by its customers so that 
organizational objectives are accomplished. In the process, work is 
performed with and through organization personnel in an ever-changing 
business environment. 

(7,13,22,52,53,94,95,96,109) 


Marginal Probability - The probability of occurrence of a particular 
row or column in a Frequency table is called a marginal probability. 
These probabilities are found in the "margins" of the table. 
(7,13,53) 


Mathematics - The science dealing with numbers and the measurement, 
properties, and relationships of quantities. 


MAUM - The Multi-Attribute Utility Model (MAUM) developed at SSRI | 
decomposes a decision problem into component attributes (characteristics) 
weights (importance values), and utilities (worth assessments) and 
aggregates them computationally into a best decision alternative. 

p= MAX! ogo WW, 

“max ; F inj j 
where Ug is the utility of attribute Jj on alternative 7 and Ws is 
the weight of attribute j across all alternatives. 
(21,23,56,63,77,78,84,107) ——- 
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Maxi-Max Strategy - The maxi-max strategy is a decision rule for 
use with decision payoff matrices. For each available strategy (row), 
consider only the best possible outcome (value). Then, choose that 
strategy with the best of the best outcomes. That is, maximize the 
maximum outcome. 

(55) 


Maxi-Min Strategy - The maxi-min strategy is a decision rule for 
use with decision payoff matrices. For each available decision 
strategy (row), consider only the worst possible outcome (lowest 
value). Then, choose that strategy with the best of the worst outcomes. 
That is, maximize the minimum outcome. 
(55) 


Mean - The mean is another term for "average": the sum of the numbers 
in a set divided by the number of numbers in the set. 


where n is the number of numbers in the set X. 
(7,13.,26,42,53,55,89) 


Median - The median is a number which, when positioned within a set 
of ordered numbers, would fall in the center, i.e. at the 50% fractile. 
(7,13,26,42,53,55) | 


Memory - A branch of Cognitive Psychology, memory analysis attempts 
to model the information retention structures and characteristics of 
the human brain. 

(2,19,33,39,68,76,90,105) 
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Mini-Max Search - A type of heuristic search, the mini-max search 
technique is used when there exists an opponent whose actions restrict 
the attainment of a goal. Possible combinations of actions (or "moves") 
are examined and a best approach is chosen assuming that the decision 
maker wishes to maximize his own situation and minimize his opponent's 
Situation. Mini-max search is used often in game-playing programs. 
(9,18,28,65,75,80,81 ,91) 


- Mini-max Strategy - Mini-max strategy is a decision rule for use with 
decision (game) matrices. Select the lowest value in each column 
(opponent's choice) of the matrix. Choose the decision strategy (row) 
that has the highest of these values. That is, maximize the minimums. 
(18,20,52,118,121) 


Mode - The mode is that value in a set of numbers that occurs most 
frequently. | | 
(7,13,53) 


Monte Carlo Simulation - Monte carlo Simulation is a name given by 
von Neumann and S.M. Ulam to a technique for solving problems that 
are too expensive for experimental solution or too difficult for 
analytic treatment. The technique involves the construction of a 
computational model of the problem and, through repeated execution, 
an approximate solution can be found by analysis of a large number 
of simulated outcomes. 

(14,22,72,109) 


Multi-Attribute Utility - Multi-attribute utility is a technique of 
decomposing a single utility measurement into its component charac- 
teristics or "attributes". Each attribute can then be evaluated 
separately with utility measures as well as measures of relative 
importance. Overall utility is obtained by a linear combination 

of the values for the component attributes. 
(21,23,56,63,77,78,84,107) 
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MYCIN - The knowledge-based system called "MYCIN" was developed 

at Stanford University by B. Buchanan and S. Cohen for the purpose 
of expert consultation in the area of antimicrobial therapy for 
infectious blood diseases. 


(6) 


Non-Deterministic Classifiers - A non-deterministic (non-parametric) 
classifier is a pattern recognizer that relies upon a distance 
"metric" between observed objects in a class in order to categorize 
new objects. The "distance" from an object to a class of objects may 
be taken either to a representative object in the class or to a 7 
calculated class centroid. 

(79,116) 


Normal Distribution - The "bell" shaped curve that results when the 
number of trials of a binomial distribution becomes infinite is 
called a "normal distribution". . 


where Hy is the mean and Oy is the standard deviation. | 
(7,13,42,53) 

Operations Research - "Operational Research is the application of 
scientific methods, techniques, and tools to problems involving the 
operations of a system so as to provide those in control of the system 
with optimum solutions to the problems." Churchman, Ackoff, Arnoff. 
"Operations Research is the art of winning wars without actually 
fighting." Arthur C. Clarke. | 

(14,20,22,95,109) 
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Optimal Paths - The optimal path in a decision tree is determined by 
(1) the utilities placed at the end of each path from the root, 

(2) the internal node types, and (3) the probabilities placed on 
each event outcome. Every decision node has a value equal to the 
maximum of the values of the nodes succeeding it; every event node 
takes the expected value of the nodes succeeding it. The highest 
values determine the optimal paths. 
(11,12,15,23,43,47,63,64,82,89,104,122) 


Pareto Optimality - Pareto optimality is a decision option or 
Strategy measured by a joint utility function from members of a 
decision group. The decision option is "Pareto optimal" if there 

is no alternative decision option that is at least as acceptable 

to all members and definitely preferred by some members. That is, 

a joint action is Pareto optimal if it is not possible (by changing 
strategy) to make one individual better off without also making 
another individual worse off. 

(89) 


Pattern Recognition - A mathematical technique, pattern recognition 
has the capability to classify objects into prescribed categories 

by trial and error after observing a number of samples without 
being provided with the decision rules. The classifier must be 
"trained" with a known set of objects before it can recognize new 
objects. | | oe 
(79,116) 


Payoff Matrices - The use of payoff matrices is a decision technique 
that does not involve uncertain events. A payoff matrix has rows 
corresponding to the possible decision alternatives (strategies), 
columns corresponding to the possible states of the world (unknown 
Situations), and entries corresponding to the gain or loss (either 
money or utility) for every combination of decision Choice and state 
of the world. | | | 
(3,10,29,55,57,117) 


2] 


¥ 


Perception - A branch of Cognitive Psychology, perception deals 
with an individual's understanding and interpretation of environ- 
mental stimuli and their effect on rational behavior. 
(2,4,19,30,33,39,49,68,76,90,105,112,119,) 


PERT Charts - The PERT chart is a statistical technique using networks 
"that quantifies knowledge about the uncertainty faced in completing 
time-dependent projects and activities. Its use may aid the timely 
acheivement of program deadlines by drawing attention to danger 
Signals that could cause time delays in task completion. 

(7,16,72) 


PIP - The Probabilistic Information Processing (PIP) model was 
developed by W. Edwards at SSRI for the purpose of solving decision 
problems based on uncertain events. The model uses probability 
estimates for events which are decomposed into micro-events and 
outcomes. | 

(40) 


Planning Models - While most decision models are concerned wjth 
one-time or "single-shot" decision problems, planning models aid 
in developing long range plans consisting of many actions in 
sequence. Sometimes "contingency plans" are developed which prescribe 
actions based on the outcomes of future events. As well as global 
strategy planning, such models may include probability estimation, 
cost-benefit analysis, resource allocation, etc. 
(8,32,50,63,64,88,94,96,) | 
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Probability Calibration - Probability calibration is a technique 

which can evaluate the ability of a particular person to estimate 
the probability of uncertain events. The result is a curve which 

can be used as a calibration standard to modify his estimates and 
obtain a more accurate measurement. 

(66,67,69) 


Probability Measurement - The measurement of probability can be 
formulated in a number of common ways: (1) a "probability" between 

O and 1, for example, a 1/5 or .2 chance; (2) a "chance", for example, 
1 chance in 5; (3) a "percentage", for example, a 20% chance; and 

(4) as "odds", for example, 1 to 4 odds. | 

(26,38,44,102, ) : 


Probability Models - Probability models are computer systems that 
aid decision making by the elicitation of subjective probabilities. 
Such systems do not usually deal with utilities. 


(34,40,44,45,99,103) 


Probability Theory - A branch of Mathematics, probability theory deals 
with the measurement of the likelihood of occurrence of uncertain 
events. ) | | _ 
(7,13,26,38,42,44,53,93,101) 


Problem Solving System - The Problem Solving System was developed 
at JPL and is a knowledge-based system for the purpose of aiding 
mission scientists in relaying commands to planetary spacecraft. 


(6) 
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Production Rules - A production rule is a method of representing 
knowledge in a knowledge-based system. A "rule" is a specification 

of a conditional action and consists of 2 main parts: (1) a 
condition (or antecedent) which describes a situation and (2) a 

action (or consequent) which describes a process that may be ated 
if the condition is satisfied. 

(6,71,106) 


PROSPECTOR - The PROSPECTOR system is a knowledge-based model 
developed at SRI by R.O. Duda for the purpose of expert consultation 
On exploratory Geology. 


(6) 


Psychology - Psychology is the science of mind, mental states, 
and processes of a person or persons in order to explain actions, 
thought, emotions, and behavior. > 
(2,19,33,76,90,92,113) 


Queueing Theory - Queueing (waiting line) problems occur when the 
capacity of a service system is inadequate to process all of-the 
demand upon that system. Adjustments to the system to handle 
additional input must be weighed against additional costs. Queueing 
theory attempts to optimize system service while minimizing cost. 
(7,22,72,95,109) 


Regression Analysis - Regression analysis is the mathematical 
extension of past data relationships into the future for the purpose 
Of prediction. A major portion of regression analysis is "curve 
fitting": the attempt to specify a mathematical function which 
closely matches observed data. 

(22,42) | 
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Resource Allocation Search - Resource allocation search is a type 
of heuristic search which does not involve an Opponent. Most 
applicable to resource allocation problems, this type of search 
technique examines possible combinations of actions in order to 
select a best set for fulfilling a goal objective. 

(80) | 


Revision of Prior Probabilities - Revising prior probabilities 
involves the use of Bayes' rule to obtain a better and more accurate 
estimate of marginal probabilities originally obtained by subjective 
judgment. The revision of prior probabilities is based on the outcome 
of a sample. | 

(53,89) 


Risk Analysis - Risk analysis is the study of potential losses due 
_ to making non-optimal decisions and involves the characterization 

of acceptable risks and the quantification of risk in terms of utility. 
(7,23,30,53,54,89) 


Risk Sharing - Risk sharing is the diversification of potential 
losses among members of a group according to their individual 
utility functions. © | 

(89) 


RITA - RITA is a knowledge-based system developed at RAND Corp. by 
R. Anderson for the purpose of aiding terminal user agents. 


(6) 


Sampling - Sampling involves a random selection of items from a large 
population such that every item in the population has an equal chance 
of being included in the sample. Further, every possible combination 
of items that could make up a given size sample must have an equal 
chance of being selected. 

(7,13,42,53,89) 


Savage Regret Strategy - The Savage regret strategy is a decision 
rule for use with decision payoff matrices. From the original 
payoff matrix, make a new "regret" matrix by taking, for each 
outcome (column), the difference between the highest value and 
the other values. Rank each row by its greatest value (loss) and 
select the one with the least loss. 

(55) 


scheduling - Scheduling problems occur when multiple tasks or jobs 
must be processed by a system that can handle only a few at a time. 
Optimal placement of jobs, each with a different completion time, 
is generally not easily solved. 

(22,95,109) 


Semantic Nets - A semantic net is a structure for representing 
knowledge in a knowledge-based system. It is built of knowledge 
"chunks" that are relations among relevant data items. For example, 
the following picture specifies a hierarchical relationship among 
members and classes. | | 
is | | is. | 
DOG ————————_S“MAMMAL —————>_ ANIMAL 


(6) 


sensitivity Analysis - Sensitivity analysis involves the adjustment 
of system inputs in order to observe the effect on the outputs. 

In Decision Making, it is a technique applied to decision trees 

to determine the most "sensitive" node. This node has the most 
chance of affecting the total tree in a significant way and, thus, 
should be analyzed in more depth. | 
(34,64,88,122) | 
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Standard Deviation - The standard. deviation is a measure of the 
uniformity or dispursion within a set of numbers. 


where X is the mean and n is the number of numbers in the set. 
(7,13,42,53) 


Statistical Decision Rules - A statistical decision rule is a 
procedure for testing a statistical hypothesis where the accept/ 
reject criteria have been determined in advance for all possible 
sample outcomes. For example: "Take a random sample of 100 light 
bulbs from this shipment of 10,000. If 8 or more bulbs are defective, 
return the entire shipment, otherwise accept it." 

(7,42,53) 


Statistical Decision Theory - Statistical decision theory is the 
use of statistics to formulate decision rules and guidelines for 
the selection of beneficial courses of action based on information 
gained through sampling. | | 
(53,101) 


Statistical Inference - Statistical inference is the formulation 
of hypotheses and conclusions about a large collection of data 
based upon information gained through sampling. 

(53,101) 


Statistical Measurement - A single number that carries information 
about characteristics of a large group of numbers is a measurement 
in statistics. | | 

(42) 
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Statistics - Statistics is that branch of Mathematics dealing with 
the science of collecting and classifying numerical facts in order © 


to show their characteristics and significance. 
(42) 


Subjective Judgment - Numerical estimates that come from an individual 
“are called "subjective" when they are based upon his knowledge, ability 
and experience and not upon mathemetical computation. 
(23,37,44,45,49,51,99,114) 


Subjective Probability - An estimate is a subjective probability 
if it is the specification of the probability of a random event 
pronounced by a decision maker based on his own experience and 
expertise alone. 

(44,45,49,89,99) 


Subjective Utility - Subjective utility is the value or worth of 

a decision alternative to a decision maker based on his own exper- 
tise and value system. | | 
(23,37,48,51,55,89,92,103,107,108) 


Systems Analysis - Systems analysis is the study of the behavior 

of "systems": a set of objects together with relationships between 
their attributes. Systems analysis includes modeling, simulation, 
queueing, feedback, control, planning, management, dynamics, and 

experimentation. | | | | 
(16,72,85,94) 


systems Simulation - Systems simulation involves the construction of 

a working mathematical, computer, or physical model containing 
Similarity of properties or relations with the natural or technological 
system under study. | | 
(2,14,16,71,72,85,91,101,106) 
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TREE - TREE is a decision aiding system developed at SRI which 
elicits a decision tree from an individual decision maker. The 
program uses sensitivity analysis to direct questioning and tree 
expansion. ) 

(122) 


Type I and Type II Errors - In Statistical Decision Theory, a 
Type I error occurs when a true hypothesis has been rejected; a 


Type II error occurs when a false hypothesis has been accepted. 


Hypothesis is in fact: 


— Decision | TRUE ot 9 FALSE 
Accept - Correct Type II Error 
Reject | Type I Error Correct 


(53) 

Utility Models - A utility model is a computer system that aids 
decision making by the elicitation of subjective utilities. Such 
decision systems do not usually involve uncertain events. 
(21,29,57,63,84,89,107,108) ee 


‘Utility Theory - Utility theory is the study of human preferences 
as they relate to the selection of one alternative from a set of 
available alternatives. "Utility" is a numerical measure of these — 
preferences. _ | | | | | 

- (23,53,55,89,108) 


Value of Information - In making a decision with less than perfect 
information, some expected loss will occur due to the uncertainty 

of event outcomes and states of the world. The reduction in loss 
given perfect information is the value or "worth" of the information. 
(7,53,89) oo 
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Variance - The variance is a statistical measure of the uniformity 
or dispursion within a group of numbers that uses the eauerce. 
deviations from the mean. 
z (X-x)* 
VAR(X) = ——— 
n 


where X is the mean and n is the number of numbers in the set. 
(7,42,53) | 


Venn Diagram - A Venn diagram - is a simple picture that deccrabes 
the inclusion relationships among ‘a number of sets. | 


Universe U 
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